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^ ' Abstract. The paper concerns the study of new classes of nonhncar and nonconvex optimization 

problems of the so-called infinite programming that are generally defined on infinite-dimensional 
spaces of decision variables and contain infinitely many of equality and inequality constraints with 
arbitrary (may not be compact) index sets. These problems reduce to semi-infinite programs in 
the case of finite-dimensional spaces of decision variables. We extend the classical Mangasarian- 
Fromovitz and Farkas-Minkowski constraint qualifications to such infinite and semi-infinite programs. 
, The new qualification conditions are used for efficient computing the appropriate normal cones to 

• sets of feasible solutions for these programs by employing advanced tools of variational analysis and 

I generalized differentiation. In the further development we derive first-order necessary optimality 

(-H ' conditions for infinite and semi-infinite programs, which are new in both finite-dimensional and 

' infinite-dimensional settings. 

1 Introduction 

(N 

J> . The paper mainly deals with constrained optimization problems formulated as follows: 

(N 

^ . J minimize f{x) subject to , , 

(V-i ; 1 9t(.x) < with teT and h{x) =0, ^ ' ^ 

cn , _ 

Q , where f : X ^ M := (—00,00] and gt : X ^ IR as t ^ T are extended-real- valued functions 

defined on Banach space X, and where h : X Y is a mapping between Banach spaces. 
An important feature of problem (II. 1|) is that the index set T is arbitrary, i.e., may be infi- 
nite and also noncompact. When the spaces X and Y are finite-dimensional, the constraint 
^ I system in (jl.ip can be formed by finitely many equalities and infinite inequalities. These op- 

timization problems belong to the well-recognized area of semi-infinite programming (SIP); 
see, e.g., the books [131 114j and the references therein. When the dimension of the decision 
space X as well as the cardinality of T are infinite, problem (11.10 belongs to the so-called 
infinite programming; cf. the terminology in [H [9] for linear and convex problems of this 
type. We also refer the reader to more recent developments [U El HOl HU |l2l [20] concerning 
linear and convex problems of infinite programming with inequality constraints. 

To the best of our knowledge, this paper is the first one in the literature to address non- 
linear and nonconvex problems of infinite programming. Our primary goal in what follows 
is to find verifiable constraint qualifications that allow us to establish efficient necessary 
optimality conditions for local optimal solutions to nonconvex infinite programs of type 
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(jl.ip under certain differentiability assumptions on ttie constraint (while not on the cost) 
functions. In this way we obtain a number of results, which are new not only for infinite 
programs, but also for SIP problems with noncompact (e.g., countable) index sets. 

It has been well recognized in semi-infinite programming that the Extended Mangasarian- 
Fromovitz Constraint Qualification (EMFCQ), first introduced in [18], is particularly use- 
ful when the index set T is a compact subset of a finite-dimensional space and when 
g{x,t) := gt{x) G C{T) for each x G X; see, e.g., [SlElinillSlliniEIllMllMlEH] for 
various applications of the EMFCQ in semi-infinite programming. Without the compact- 
ness of the index set T and the continuity of the inequality constraint function g{x,t) with 
respect to the index variable t, problem (jl.ip changes dramatically and-as shown below- 
does not allow us to employ the EMFCQ condition anymore. That motivates us to seek 
for new qualification conditions, which are more appropriate in applications to infinite pro- 
grams as well as to SIP problems with noncompact index sets and infinite collections of 
inequality constraints defined by discontinuous functions. 

In this paper we introduce two new qualification conditions, which allow us to deal with 
infinite and semi-infinite programs of type (jl.ip without the convexity/linearity and com- 
pactness assumptions discussed above. The first condition, called the Perturbed Mangasarian- 
Fromovitz Constraint Qualification (PMFCQ), turns out to be an appropriate counterpart 
of the EMFCQ condition for infinite and semi-infinite programs (jl.ip with noncompact in- 
dex sets T and discontinuous functions g{x, •). The second condition, called the Nonlinear 
Farkas- Minkowski Constraint Qualification (NFMCQ), is a new qualification condition of 
the closedness type, which is generally independent of both EMFCQ and PMFCQ conditions 
even for countable inequality constraints in finite dimensions. 

Our approach is based on advanced tools of variational analysis and generalized differ- 
entiation that can be found in |22jl23j. Considerably new ingredients of this approach relate 
to computing appropriate normal cones to the set of feasible solutions for the infinite/semi- 
infinite program (jl.ip given by 

0:= {xe X\ h{x) = 0, gt{x) < as t G T}. (1.2) 

Since the feasible solution set is generally nonconvex, we need to use some normal cone 
constructions for nonconvex sets. In this paper we focus on the so-called Frechet/regular 
normal cone and the basic/limiting normal cone introduced by Mordukhovich; see |22j 
with the references and commentaries therein. Developing general principles of variational 
analysis, we employ this approach to derive several necessary optimality conditions for the 
class of nonlinear infinite programs under consideration. 

The rest of the paper is organized as follows. In Section 2 we present basic definitions as 
well as some preliminaries from variational analysis and generalized differentiation widely 
used in this paper. Section 3 is mainly devoted to the study of the new PMFCQ and 
NFMCQ conditions for infinite programs in Banach spaces. Relationships between the 
new qualification conditions and other well-recognized constraint qualifications for SIP and 
infinite programs are discussed here. 

In Section 4, we provide exact computations for the Frechet and limiting normal cones 
to the feasible set of (jl.ip under the PMFCQ and NFMCQ conditions. This part plays a 
crucial role for the subsequent results of the paper. Following this way. Section 5 concerns 
the derivation of necessary optimality conditions for local minimizers of the infinite and 
semi-infinite programs under consideration. 

Our notation and terminology are basically standard and conventional in the area of 
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variational analysis and generalized differentials.; see, e.g., |22tl24j. As usual, || • || stands for 
the norm of Banach space X and (•, •) signifies for the canonical pairing between X and its 

topological dual X* with the symbol ^ indicating the convergence in the weak* topology 
of X* and the symbol cl* standing for the weak* topological closure of a set. For any x X 
and r > 0, denote by lBr{x) the closed ball centered at x with radius r while IBx stands 
for the closed unit ball in X. 

Given a set C X, the notation co0 signifies the convex hull of while that of 
cone stands for the convex conic hull of 0, i.e., for the convex cone generated by U {0}. 

Depending on the context, the symbols x ^ x and x ^ x mean that x ^ x with x € 
and X — )■ X with ip{x) — >■ ^{x) respectively. Given finally a set-valued mapping F: X ^ X* 
between X and X* , recall that the symbol 



Limsup-F(x) := < x* € X* 



3Xr 



31 * 

d x„ 



with X* e F{xn), n e M 



} (1-3) 



stands for the sequential Painleve-Kuratowski outer /upper limit F as x ^ x with respect 
to the norm topology of X and the weak* topology of X* , where IN := {1, 2, . . .}. 



2 Preliminaries from Generalized Differentiation 

In this preliminary section we briefly review some constructions of generalized differentiation 
used in what follows; see [3l [22} [2^ [25] for more details and related material. Throughout 
this paper, unless otherwise stated, all the spaces under consideration are Banach. 

Given an extended-real- valued function Lp: X ^ M := (— oo, oo], we always assume that 
it is proper, i.e., (p ^ oo. The notation 

domif := |x G X\ ip{x) < oo} and epiip := {(x,r) € X x JR| r > y'(x)} 

are used for the domain and the epigraph of (p, respectively, 
Define the analytic e-subdifferential of (/? at x € dom ip by 

dM^):=\x*eX* hminf '^^'^-'^f^-f '^-^^ >-4, e>0 (2.1) 

I x^x ||x — x|| J 

and let de'-p{x) := for x ^ dom 93. If e = 0, the construction dip{x) := dQip{x) in (j2.ip is 
known as the Frechet or regular subdifferential of ip at x; it reduces in the convex case to the 
classical subdifferential of convex analysis. The sequential regularization of (|2.ip defined 
via the outer limit (jl.3p by 

dip{x) := Limsup d£ip{x), (2-2) 
£4-0 

is known as the limiting, or basic, or Mordukhovich subdifferential of at x G dom ip. It can 
be equivalently described with e = in (|2.2p if ip is lower semicontinuous (l.s.c.) around x 
and if X is an Asplund space, i.e., each of its separable subspace has a separable dual (in 
particular, any reflexive space is Asplund; see, e.g., [31 [22] for more details and references). 
We have dip{x) 7^ for every locally Lipschitzian function on an Asplund space. 
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A complementary construction to (|2.2|) . known as the singular or horizontal subdijjer- 
ential of (/9 at x, is defined by 

5°°v?(x) := LimsupA^VJCx), (2.3) 

A,e4.0 

wliere we can equivalently put e = if (/? is l.s.c. around x and X is Asplund. Note tliat 
d°°ip{x) = {0} if if is locally Lipschitzian around x. The converse implication also holds 
provided that is l.s.c. around x, that X is Asplund, and that (p satisfies the so-called 
"sequential normal epi-compactness" property at x (see below), which is always the case 
when X is finite-dimensional. 

Given a set C X with its indicator function 5{-;0) defined by 5{x]0) := for 
x € and by 5{x; 0) := oo otherwise, we construct the Frechet/ regular normal cone and 
limiting /basic /Mordukhovich normal cone to at x € by, respectively, 

N{x;0) ■.= d5{x;0) and N{x;0) := d5{x;0) (2.4) 

via the corresponding subdifferential of the indicator function. If follows from (j2.4p that 
A^(x; 0) C A^(2;;0). A set is normally regular at x if N{x]0) = N{x;0); the latter is 
the case of convex and some other "nice" sets. 

Recall further that is sequentially normally compact (SNC) at x G if for any 

sequences £n 4 0, x, and x* G Ni.^{xn', 0) := 5e„5(x; 0) we have 

[x* ^ O] =^ [ll^^nll ~^ O] as n — )• OO, 

where e„, can be omitted if is locally closed around x and the space X is Asplund. A 
function (p : X ^ ]R \s sequentially normally epi-compact (SNEC) at a point x € doimp 
if its epigraph is SNC at (x,(/9(x)). Besides the finite dimensionality, the latter properties 
hold under certain Lipschitzian behavior; see, e.g., [221 Subsections 1.1.4 and 1.2.5]. 

Having an arbitrary (possibly infinite and noncompact) index set T as in (jl.ip . we 
consider the product space of multipliers iR^ := {A = (At)| t G T} with A* G iR for t G T 
and denote by the collection of A G such that A^ 7^ for finitely many t ^ T. The 
positive cone in IR^ is defined by 

Ml := {A G if\ At > for ah t G T}. (2.5) 



3 Qualification Conditions for Infinite Constraint Systems 

This section is devoted to studying the set of feasible solutions to the original optimization 
problem (|l.ip defined by the infinite constraint systems of inequalities and equalities 

gtix)<0, teT, 

h{x) = 0, ^"^-^^ 

where T is an arbitrary index set, and where the functions gt : X ^ M, t £ T, and the 
mapping h : X ^ Y are differentiable but may not be linear and/or convex. As in (jl.2p . 
the set of feasible solutions to (II. Ij) . i.e., those x G X satisfying (j3.ip . is denoted by 0. 

Our standing assumptions throughout the paper (unless otherwise stated) are as follows: 
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(SA) For any x G the functions gt, t , are Frechet dijjerentiable at x and the mapping 

h is strictly differentiable at x. The set {Vgt(x)| t G T} is bounded in X* . 

Recall that a mapping h: X ^ Y is strictly differentiable at x with the (strict) derivative 
Vh{x) : X^Y \i 

lim_ ^^^^ ~ ^^^'^ ~ ~ _ Q 

The latter holds automatically when h is continuously differentiable around x. 

In addition to the standing assumptions (SA), we often impose some stronger require- 
ments on the inequality constraint functions gt that postulate a certain uniformity of their 
behavior with respect to the index parameter t gT. We say that the functions {gt}teT are 
uniformly Frechet differentiable at x if 

/ N \Qf{x) — Qtix) — (V qt{x],x — x)\ 
s{t]) := sup sup ^^^^ — _ , ^ ^' ^0 as r/ i 0. (3.2) 



Similarly, the functions {gt}tGT are uniformly strictly differentiable at x if condition (13. 2p 
above is replaced by a stronger one: 

r(,) := sup sup \9t{-) - 9t{x')- {V gt{x),x - x')\ ^33^ 

iST x,x'elBr,ix) If ~ ^ II 

Xy^x' 

which clearly implies the strict differentiability of each function (7^, t G T, at x. 

Let us present some sufficient conditions ensuring the fulfillment of all the assumptions 
formulated above for infinite families of inequality constraint functions. 

Proposition 3.1 (compact index sets). Let T be a compact metric space, let the func- 
tions gt in (13. ip be Frechet differentiable around x for each t ^ T , and let the mapping 
{x,t) G A X T I— > Vgt{x) G A* be continuous on ]Bn{x) x T for some rj > 0. Then the 
standing assumptions (SA) as well as (13. 2p and (13. 3p are satisfied. 

Proof. It is easy to see that our standing assumptions (SA) hold, since ||V(7j(x)|| is assumed 
to be continuous on the compact space T being hence bounded. It suffices to prove that 
()3.3p holds, which surely implies (13. 2p . 

Arguing by contradiction, suppose that ()3.3p fails. Then there are e > 0, sequences 
{tn} C T, {r]n} i 0, and {x^}, {x'^} C -/B^„(x) such that 

\9tM - 9tA<) - {^mA^Un - 01 > , _ i fo, large n G IN. (3.4) 



I Xfi "^77, 1 1 ^ 



Since T is a compact metric space, there is a subsequence of {t^} converging (without 
relabeling) to some t £ T. Applying the classical Mean Value Theorem to (j3.4p . we find 
£ [3^n)3;^] := co{xn,x'^} such that 

e / \{^9tA0n),Xn - x'^) - {S/gt„{x),Xn - x'^)\ 

Z \\Xn 

< W'^gtM - "^gmW + llv^K^) - Vgt„{x)\\ 
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for all large n G IN. This contradicts the continuity of the mapping {x,t) G X x T i— )■ Vgt{x) 
on ]Brf{x) X T and thus completes the proof of the proposition. A 

Next we recall a well-recognized constraint qualification condition, which is often used 
in problems of nonlinear and nonconvex semi-infinite programming. 

Definition 3.2 (Extended Mangasarian-Fromovitz Constraint Qualification). The 

infinite system satisfies the Extended Mangasarian-Fromovitz Constraint 
Qualification (EMFCQ) at x £ Q if the derivative operator Vh{x): X ^ Y is sur- 
jective and if there is x € X such that Vh{x)x = and that 

{Vgt{x),x) < for all t G T{x) := {t G T\ gt{x) = O}. (3.5) 

It is clear that in the case of a finite index set T and a finite-dimensional space Y 
in (j3.ip the EMFCQ condition reduced to the classical Mangasarian-Fromovitz Constraint 
Qualification (MFCQ) in nonlinear programming. In the case of SIP problems the EMFCQ 
was first introduced in [18] and then extensively studied and applied in semi-infinite frame- 
works with X = ]RJ^ and Y = iR"; see, e.g., [151 [T9l [2T| I27j . where the reader can find its 
relationships with other constraint qualifications for SIP problems. 

To the best of our knowledge, the vast majority of nonconvex semi-infinite programs 
are usually considered with the general assumptions that the index set T is compact, the 
functions gt are continuously differentiable, and the mapping (x,t) i— > Vgt{x) is continuous 
on X X T. Under these assumptions and the EMFCQ formulated above, several authors 
derive the Karush-Kuhn- Tucker (KKT) necessary optimality conditions of the following 
type: If x is an optimal solution to (|l.ip with f & and h = {hi, h2, ■ ■ ■ , hn), then there 
are A G from (f23]l and fi e JR^ such that 

n 

= V/(x)+ ^ AtV5t(x) + J^MjV/ij(x). (3.6) 

iGT(x) j=l 

We are not familiar with any results in the literature on nonconvex infinite programming 
that apply to problems with noncompact index sets T. The following example shows that 
the KKT optimality conditions in form ()3.6p may fail for nonconvex SIP with countable 
constraints even under the fulfillment of the EMFCQ. 

Example 3.3 (violation of KKT for nonconvex SIP with countable sets under 
EMFCQ). Consider problem (jl.ip with countable inequality constraints given by 

{minimize {xi + 1)^ + X2 subject to 
xi + 1 < and — x? - X2 < for aU n G W \ {1} with (xi,X2) G M^. ^^''^^ 
3n 

Let X := M"^, Y := {0}, f{xi,X2) := (xi + 1)^ + X2, T := W, 5i(xi,X2) := xi + 1, and 
1 „ 

gn{xi,X2) := — Xi — X2 for all n G 1V\ {!}. Observe that x := (—1, 0) is a global minimizer 

for problem (j3.7p and that T(x) = {1} for the active index set in (13. Sp . It is easy to check 
that the EMFCQ holds at x while there is no Lagrange multiplier A G iR+ satisfying the 
KKT optimality condition (13. 6p at x. Indeed, we have (Vgi(x), (—1,0)) = — 1 < 0, and 
the following equation does not admit any solution for A > 0: 

(0, 0) = V/(x) + AV5i(x) = (0, 1) + (A, 0). 
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Now we introduce a new extension of the MFCQ condition to the infinite programs 
under consideration, which plays a crucial role throughout the paper. 

Definition 3.4 (Perturbed Mangasarian-Promovitz Constraint Qualification). We 

say that the infinite system (|3.fp satisfies the Perturbed Mangasarian-Fromovitz 
Constraint Qualification (PMFCQ) at x e if the derivative operator Vh{x) : X -> 
Y is surjective and if there is x & X such that V/i(x)x = and that 

inf sup {Vgt{x),x)<0 with T^^x) := {t £ T\ gt{x) > -e} . (3.8) 

In contrast to the EMFCQ, the active index set in (|3.8p is perturbed by a small e > 0. 
Since T{x) C Ts{x) for all e > 0, the PMFCQ is stronger than the EMFCQ. However, 
as shown in Section 4 and Section 5, the new condition is much more appropriate for 
applications to semi-infinite and infinite programs with general (including compact) index 
sets than the EMFCQ. 

The following proposition reveals some assumptions on the initial data of (|3.ip ensuring 
the equivalence between the PMFCQ and EMFCQ. 

Proposition 3.5 (PMFCQ from EMFCQ). Let T be a compact metric space, and let 
X G in (13. ip . Assume that the function t G T gt{x) is upper semicontinuous (u.s.c.) 
on T, that the derivative mapping V/i(x) : X ^ Y is surjective, and that there is x G X 
with the following properties: Vh{x)x = 0, the function t £ T ^ {\/gt{x),x) is u.s.c, 
and (S/gt{x),x) < for all t S T[x). Then the PMFCQ condition holds at x, being thus 
equivalent to the EMFCQ condition at this point. 

Proof. Arguing by contradiction, suppose that the PMFCQ fails at x. Then it follows 
from (|3.8p that there exist sequences {Sn} J, and C T such that t„ G Ten(^) and 

{VgtAx),x) > -- for all n e IN. 
n 

Since T is a compact metric space, we find a subsequence of {tn} (no relabeling), which 
converges to some t £ T. Observe from the continuity assumptions made imply that 

dti^) ^ hmsupflff^Xx) > limsup— En = and 

n— >oo n— >oo 

(Vgi{x),x) > limsup{Vgt„{x),x) > limsup = 0. 

n—^cx) n— >oo n 

Thus we have that t G T{x) and (S/gi{x),x) > 0, which is a contradiction that completes 
the proof of the proposition. A 

The following example shows that the EMFCQ does not imply the PMFCQ (while not 
ensuring in this case the validity of the required necessary optimality conditions as will be 
seen in Sections 4 and 5) even for simple frameworks of nonconvex semi-infinite programs 
with compact index sets. 

Example 3.6 (EMFCQ does not imply PMFCQ for semi-infinite programs w^ith 
compact index sets). Let X = IB? and T = [0, 1] in (|3.ip with /i = and 

g^ix) := xi -Fl < 0, gt{x) := txi - x^ < for t£T\ {0}. 
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It is easy to check that the functions gt, t G T, satisfy our standing assumptions and 
that they are strictly uniformly differentiable at the feasible point x = (—1,0). Observe 
furthermore that T{x) = {0}, that T^{x) = [0,e] for all e G (0,1), and that the EMFCQ 
holds at X. However, for any d = {di,d2) € we have 



inf sup (V5t(x),(i) = misup\{Vgoix),d),sup{{'Vgt{x),d)\te{0,e]}\ 
= inf sup \ di , supjtdi I t G (0, e] } > > 0, 

e>0 I J 

which shows that the PMFCQ does not satisfy at x. Note that the u.s.c. assumption with 
respect of t in Propositions 13.51 does not hold in this example. 



It is well known in the classical nonlinear programming (when the index set T in (j3.ip 
is finite), that the MFCQ condition is equivalent to the Slater condition provided that 
all the functions gt are convex and differentiable and that h \s a, linear operator. The 
next proposition shows that a similar equivalence holds in the semi-infinite and infinite 
programming frameworks with replacing the MFCQ by our new PMFCQ condition and 
replacing the Slater by its strong counterpart well recognized in the SIP community; see, 
e.g., [H] and [5] for more references and discussions. 

Proposition 3.7 (equivalence between PMFCQ and SSC for differentiable con- 
vex systems). Assume that in ()3.ip all the functions gt, t ^T, are convex and uniformly 
Frechet differentiable at x and that h = A is a surjective continuous linear operator. Then 
the PMFCQ condition is equivalent to the following strong Slater condition (SSC): there is 
X ^ X such that Ax = and 

snvgt{x)<Q. (3.9) 

Proof. Suppose first that the SSC holds at x, i.e., there are x G X and 5 > such that 
Ax = and gtix) < —26 for all t € T. By the assumptions made this implies that for each 
e G (0, S) and t G Ti;{x) we have 

{Vgt{x),x - x) < gt{x) - gt{x) < -26 + e < -5. 

Define further x := x — x and get Ax = Ax — Ax = with {'Vgt{x),x) < —5 for all t G T^{x) 
and £ G (0, 6). This clearly implies the PMFCQ condition at x. 

Conversely, assume that the PMFCQ condition holds at x. Then there are e, > and 
X X such that {'\/gt{x),x) < —r] for all t G 7e(x) and that Ax = 0. It follows from the 
assumed uniform Frechet differentiability (13. 2p of gt at x that for each A > we have 

gt{x + Xx) < gt{x) + X{Vgt{x),x) + AP||s(AP||), (3.10) 

which readily implies that gt{x + Xx) < X[ — r]+ ||x||s(A||'r||)) for all t G Ti;{x). For t ^ T^{x) 
we observe from (I3.10j) that 

gt{x + Ax) < — e + A sup \\S/gr{x) || • ||x|| + A||x||s(A||x||) , 

tGT 

which gives, combining with the above, that 

sup (7j(x + Ax) < max |A( — rj + ||x|[s(A||x||)) , —e + A||x|| ( sup ||V(/t-(2;)|| + s(A||x||)) }. 

tGT tGT 
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The latter implies the existence of Aq > sufficiently small such that supi^^p g^(x) < with 
X := X + Xqx. Furthermore, it is easy to see that Ax = Ax + XqAx = 0. This concludes 
that the SSC holds at x and thus completes the proof of the proposition. A 

Next we introduce another qualification condition of the closedness/Farkas-Minkowski 
type for infinite inequality constraints in (ll.ip . 

Definition 3.8 (Nonlinear Farkas-Minkowski Constraint Qualification). We say 

that system (13.ip with h{x) = satisfies the NONLINEAR Farkas-Minkowski constraint 
QUALIFICATION (NFMCQ) at X if the set 

cone { (Vgt(x), {Vgt{x),x) - gt{x)) | t G T} (3.11) 

is weak* closed in the product space X* x M. 

In the linear case of gt{x) = {al,x) - ht for some {a*,bt) £ X* x M, t e T, the NFMCQ 
condition above reduces to the classical Farkas-Minkowski qualification condition meaning 
that the set cone {(oj , 6t)| t E T} is weak* closed in X* x M. It is well recognized that 
the latter condition plays an important role in linear semi-infinite and infinite optimization; 
see, e.g., [H O [H [lOl [TTl |T3] for more details and references. Observe that the NFMCQ 
condition can be represented in the following equivalent form: the set 

cone { (\/ gt{x) , gt{x)^ | t € T} is weak* closed in X* x JR. 

Let us compare the new NFMCQ condition with the other qualification conditions dis- 
cussed in this section in the case of infinite inequality constraints. 

Proposition 3.9 (sufficient conditions for NFMCQ). Consider the constraint inequal- 
ity system (13. ip with h = therein. Then the NFMCQ condition is satisfied at x £ & in 
each of the following settings: 

(i) The index T is finite and the MFCQ condition holds at x. 

(ii) dimX < oo, the set {{Vgt{x), {'Vgt{x),x) — gt{x))\ t G T} is compact, and the 
PMFCQ condition holds at x. 

(iii) The index T is a compact metric space, dimX < oo, the mappings t ^T ^ gt{x) 
and t ^T ^ Vgt{x) are continuous, and the EMFCQ condition holds at x. 

Proof. Define ]jt{x) ■= {'Vgt{x),x — x) + gt{x) for all x £ X. To justify (i), suppose that 
T is finite and that the MFCQ condition holds at x for the inequality system in (j3.ip . It is 
clear that Ijt also satisfy the MFCQ at x. Since the functions 'gt are linear, we observe from 
Proposition 13.71 that there is x G X such that 5j(x) = {'Vgt{x),x — x) + gt{x) < for all 
t £ T. Thus it follows from [101 Proposition 6.1] that the NFMCQ condition holds. 

Next we consider case (ii) with X = IR'^ therein. Suppose that the PMFCQ condition 
holds at X and that the set {{Vgt{x), {Vgt{x),x) — gt{x))\ t £ T} is compact in M'^ x M. 
Noting that the functions gt also satisfy the PMFCQ at x, we apply Proposition 13. 71 to these 
functions and find x £ X such that V/i(x)x = and that 

sup5t(x) = sup(Vfi(t(x),x - x) + gtix) < 0. (3.12) 

Let us check that (0,0) co {{V gt{x) , (W gt{x) , x) — gt{x))\ t G T}. Indeed, otherwise 
ensures the existence of A G Si^^ with ^^^^^ Af = 1 such that 

(0, 0) = ^ At {Vgt (x) , ( V5t (x) , x) - 5t (x)) . 
teT 



9 



Combining the latter with (|3.12p gives us that 



= '^Xt{Vgt{x),x) -'^Xt{{Vgt{x),x) - gt{x)) = ^\tgt{x) < sup gt{x) < 0, 

which is a contradiction. Hence employing |16l Theorem 1.4.7] in this setting, we have 
that the conic hull cone {(V^f (x), {Vgt{x),x) — gt{x))\ t G T} is closed in M'^^^. This fully 
justifies (ii). Observing finally that (iii) follows from (ii) and Proposition 13.51 we complete 
the proof of the proposition. A 

To conclude this section, let us show that the NFMCQ and PMFCQ conditions are 
independent for infinite inequality systems in finite dimensions. 

Example 3.10 (independence of NFMCQ and PMFCQ). It is easy to check that for 
the constraint inequality system from Example 13.61 the NFMCQ is satisfied at x = (—1,0), 
since the corresponding conic hull 

cone {{V gt{x), {V gt{x), x) -gt{x))\t(^T] = cone ((1, 0, -1) U {(t, 0, 0)|t G (0, 1]}) 

= {x G iR^I Xi + X3 > 0, Xi > > X3, X2 = 0} 

is closed in IB?. On the other hand, Example 13.61 demonstrates that the PMFCQ does not 
hold for this system at x. 

To show that the NFMCQ does not generally follow from the PMFCQ (and even from 
the EMFCQ), consider the countable system of inequality constraints ()3.7p in IE? discussed 
in ExampleESl When x = (-1, 0), we get Te{x) = {n G iV \ {1}| n < i} U {1} for the the 
perturbed active index set in (|3.8|) . It shows that the PMFCQ (and hence the EMFCQ) 
hold at X. On the other hand, the conic hull 

cone{(V5j(x), {Vgt{x),x) - gt{x))\ t T] = cone 

is not closed in JR^, i.e., the NFMCQ condition is not satisfies at x. 



:i,o,-i)u 



3n; 



n£ IN 



\{i}y 



4 Normal Cones to Feasible Sets of Infinite Constraints 

This section is devoted to computing both normal cones ()2.4p to the feasible solution sets 
()1.2p for the class of nonconvex semi-infinite/infinite programs (jl.ip under consideration in 
the paper. These calculus results are certainly of independent interest while they play a 
crucial role in deriving necessary optimality conditions for (jl.ip in Section 5. 

The first main theorem gives precise calculations of both Frechet and limiting normal 
cones to the set of feasible solutions in (II. 2p under the new Perturbed Mangasarian- 
Fromovitz Constraint Qualification of Definition 13. 41 Preliminary we present a known result 
from functional analysis whose simple proof is given for the reader's convenience. 

Lemma 4.1 (weak* closed images of adjoint operators). Let A : X ^ Y be a 

surjective continuous linear operator. Then the image of its adjoint operator A*{Y*) is a 
weak* closed subspace of X* . 
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Proof. Define C := A*{Y*) C X* and pick any n £ IN. We claim that the set An := 
C n nlBx* is weak* closed in X*. Considering a net {x^}uej\f C An weak* converging 
to X* £ X* and taking into account that the ball JBx* is weak* compact in X*, we get 
X* G nlBx*- By construction there is a net {yZ}u&N C Y* satisfying x* = A*yl whenever 
y G N . It follows from the surjectivity of A that 

||x*|| = \\A*yl\\ > K\\yl\\ for all i/ G TV, 

where k := inf{||A*y*|| over ||y*|| = 1} G (0, oo); see, e.g., [22l Lemma 1.18]. Hence 
||y*|| < nK~^ for all G A^. By passing to a subnet, suppose that y* weak* converges to 
some y* G Y* for which x* = A*y* G An- Thus we have that the set An = C D nIBx* is 
weak* closed for all n G W. The classical Banach-Dieudonne-Krein-Smulian theorem yields 
therefore that the set C is weak* closed in X* . A 

Now we are ready to establish the main result of this section. 

Theorem 4.2 (Prechet and limiting normals to infinite constraint systems). Let 

X £ for the set of feasible solutions (jl.2p to the infinite system (13. ip satisfying the PMFCQ 
at X. Assume in addition that the inequality constraint functions gt, t £ T, are uniformly 
Frechet dijjerentiable at x. Then the Frechet normal cone to at x is computed by 

N{x; 0) = n cfcone {Vgt{x)\ t G Te{x)} + Vh{x)*{Y*). (4.1) 

If furthermore the functions gt, t £ T, are uniformly strictly differentiable at x, then the 
limiting normal cone to at x is also computed by 

N{x; 0) = n cfcone {Vgt{x)\ t £ Te{x)} + Vh{x)*{Y*), (4.2) 

e>0 

and thus the set of feasible solutions is normally regular at x. 

Proof. First we justify (|4.ip under the assumptions made. It follows from the PMFCQ 
and the uniform Frechet differentiability of gt at x that there are e > 0, 6 > 0, and x £ X 
such that 'Vh(x)x = and 

sup {Vgt{x),x) < —S for all e < e . (4.3) 

t£T^{x) 

Let us prove the inclusion "D" in (14. ip . To proceed, fix any e G (0, e) and pick an arbitrary 
element x* belonging to the right-hand side of (j4.ip . Then there exist a net {Xu)ueAf C 
and a dual element y* £ Y* satisfying 

x*=w*-lim y Xt^Vgt{x) + Vh{x)*y*. (4.4) 

Combining the latter with (14. 3p gives us 

{x*,x) =lim ^ Xtu{'Vgt{x),x) + {Vh{x)*y*,x) 

' '""^^^"^ ^ ^ (4.5) 

<liminf > At^(— (5) + (y*, V/i(x)x) = — Jlimsup > Xtu- 
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It follows further that for each rj > and x G R IBf^{x) we have 
{x*,x-x) = lim \ty{Vgt{x),x - x) + {Vh{x)*y* ,x - x) 

< limsup ^ Atj.(^5t(x) - 5ft(x) + ||x - x||s(77)^ + (y*, V/i(x)(x - x)) 

teT,{5;) 

< limsup ^ Ati.(^e+ ||x-x|ls(7?)) + ||y*||(^||/i(x) -/i(x)|| +o(||x-x||)) 

< + ||x — x||s(77)^ limsup Aj;/ + ||y* ||o(||x — x||). 

Taking now the estimate (j4.5p into account implies that 

(x* , x^ / \ 
(x*,x - x) < ^ — + ||x - x||s(r/)j + o(||x - x||)||y*||, 

which yields in turn by e J, that 

(x*, X — x) < —- — - — ^||x — x|[s(77) + o(||x — x||) ||y* ||. 



Since 5(77) J, as r/ J, 0, it follows from the latter inequality that 

(x*,x-x) 
lim sup — TT]— < 0, 

which means that x* G A'^(x; 0) and thus justifies the inclusion "D" in (14.ip . 

Next we prove the inclusion "C" in (j4.2p under the assumption that gt are uniformly 
strictly differentiable at x. This immediately implies the inclusion "c" in (14. ip under the 
latter assumption, while we note that similar arguments justify the inclusion "C" in (j4.ip 
under merely the uniform Frechet differentiability of gt at x. 

To proceed with proving the inclusion "C" in (|4.2p . define the set 

:= crcone{Vgt(x)| i G re(x)} + V/i(x)*(y*) for e > 0. (4.6) 

Arguing by contradiction, pick an arbitrary element x* G A^(x; 0) \ {0} and suppose that 
X* ^ for some e G (0,?). We first claim that the set is weak* closed in X* for all 
e <e. To justify, take an arbitrary net {ul)u<=Af C A^^ weak* converging to some u* G X*. 
Hence there are nets {X,y)ueAf C [uDueN C 5^* such that 



^ Aj^V(7j(x) + V/i(x)*y: 



— > n 



Similarly to the proof of (|4.5p we derive the inequality 



(n*, x) < — (51imsup > Xty 



Moreover, we have 



|<- V/i(x)*2/:|| = II ^tuVgt{x)\\< sup \\Vgr{x)\\ 
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It follows from two inequalities above that the net {u* — Vh{x)*y*}u£Af is bounded in X*. 
By the classical Alaoglu-Bourbaki theorem, there is a subnet of {u* — Vh[x)*y*} (without 
relabeling) weak* converging to some v* E cl*cone|V(7((x)| t E T^{x)^. Thus the net 
{Vh{x)*y*} weak* converges to u* — v* . Due to Lemma l4.ll there is y* E Y* such that 
u* — V* = Vh{x)*y* . This implies that u* = v* + Vh{x)*y* E and ensures that is 
weak* closed in X* . Since x* ^ ^e, we conclude from the classical separation theorem that 
there are xq ^ X and c > satisfying 

(x*, xo) > 2c> > (Vgt(x), xo) + (V/i(x)*2/*, xq) = (V5t(x), xq) + {y\ V/i(x)xo) (4.7) 

for all t E Te{x) and y* E y*; hence V/i(x)xo = 0. Define further 

^ c _ 

X := Xo + -n — 7. — fp3T7^ 
||x*|| • ||x|| 

and observe that V/i(x)x = 0. Moreover, it follows from (14. 7p and the PMFCQ that 

(x*,x) = (x*,xo + -n — > 2c+ - — 7^-— — (x*,x) > 2c - c = c and (4.8) 
||x*|| • ||x|| ||x*|| • ||x| 



{Vgt{x),x) = (V^7i(x),xo) + II ||~|| (Vfff(^),a^) < - = -5 (4.9) 

If II ■ IfII If II ■ IfII 

~ Sc 

for all t E 7e(x) with S := - — - — — - > 0. Observing that x 7^ by ()4.9p . suppose without 

||x*|| • ||x|| 

loss of generality that ||x|| = 1. Furthermore, we get from definition of the limiting normal 
cone that there are sequences Sn i 0, J, 0, x„ x, and x* ^> x* as ?i — )■ 00 with 

(x* , X — x.„) < e„||x — x„|| for ah x E iBr/„(2;^^) H 0, n G M. (4.10) 

Since the mapping h is strictly differentiable at x with the surjective derivative V/i(x), 
it follows from the Lyusternik-Graves theorem (see, e.g., \22\ Theorem 1.57]) that h is 
metrically regular around x, i.e., there are neighborhoods U oi x and y of = h{x) and a 
constant fi > such that 

dist(x; /i~"'^(y)) < /u||y — /i(x)|| for any x E f/ and y&V. (4-11) 

Since h{xn) = and V/i(x)x = 0, we have 

||/i(x„ + tx)\\ = \\h{xn + tx) — h{xn) — Vh{x){tx)\\ = o(t) for each small t > 0. 

Thus the metric regularity (|4.1ip implies that for any small t > there is Xt E /i~^(0) with 
||x„ + tx — xj|| = o(t) when x„ E U. This allows us to find rjn < rjn and Xn '■= x:fj^ E /i~^(0) 
satisfying rjn + o(jjn) < r]n and |[x„ + rjnX — x^H = o(jjn). Note that 

ll^^n ^n|| ^ 1 1 2^ 1 1 ~l~ \\Xn ~l~ Xn\\ — f]n ~l~ oirjri) ^ ?7»i) 

i.e., x„ E ]Brj„{xn). Observe further that 

\\Xn ^n|| ^ ^'«ll'^ll II -^n ~l~ Xn\\ — 1]n o(^rjn)- 
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By the classical uniform boundedness principle there is a constant M such that M > || 

for all n G due to x* ^ x* as n — t- oo. It follows from (|4.8p that (x* , x) > for n G M 
sufficiently large. Then we have 



> -M ^"^'^"l^ + ^ V /x:,x). 

Since o{rjn)/rjn — >■ when n ^ oo, the latter inequalities yield that 

liminf V- u > 

n^oo — Xn\\ 

Combining this with (j4.8p and (j4.10p gives us that x„, ^ for all large n ^ JN. 

Now define m„ := x„ + r/„x — x„ and get ||m„|| = o(jjn) and ||x„ + u„ — x„|| = rjn by 
the arguments above. It follows from our standing assumptions (SA), condition (j3.3p . and 
inequality (j4.9p that for each t G 7e(3;) we have 

7 ^ 9t{x) ,rjnx) {Vgt{x),Xn + Un-Xn) ( V^t (x) , x„ - x„) {Vgt{x),Un) 

— > = 77^ 7: = —77^ 7: h 



Tfn \\Xyi -\- Un Xn\] \\Xn ~1~ Un \\Xn ~t~ Un X^] 

, ^n) ll-^n •^n II , (V5t( 



> P.-xJI ||V<7.(x)||"^^-) 



Xn XfiW ^ \\Xn -\- Ufi Xn\\ tGT^(x) ^ri 
> 7:-r{rin)]— ■ - sup llVgrW 



\Xn Xn\\ ' y^Xfi -\- Un 2^n|| rST 

where t/„ := max{|[x„ — x|[ and |[x„ — x||} ^ as n — )• 00. Note that 

r\n - Ojrjn) ^ \\Xn - Xn\\ ^ rjn + o(??n) 
1 1 Xn ~\~ Un 1 1 

which implies that — — - — )■ 1 as n — )• 00. Furthermore, since r(rjn) — )■ and 

\\Xn ~1~ '^n Xn\\ 

7- as n — )■ 00, we have gt(xn) < — ||5;n — a^nll ^ for each t € 7e(x) when n ^ IN 

Vn 2 

is sufficiently large. Indeed, assuming otherwise that t ^ 7e(x) gives us 

9t{xn) < gt{x) + {'Vgt{x),Xn - x) + \\xn - x\\r{r]n) 

< —e + sup ||V5T-(2;)||7?n + Vnr{r]n) < for all large n € IN. 

Thus gtixn) < for all t € T and also h(xn) = when n € IV is sufficiently large, i.e., 
Xn S 0, a contradiction. Hence we conclude that A^(x; 0) C for all e G (0,e), which 
implies the inclusion "c" in (|4.2p and completes the proof of the theorem. A 

Let us show now that the PMFCQ condition is essential for the validity of both normal 
cone representations in (14. ip and ()4.2p : moreover, this condition cannot be replaced by its 
weaker EMFCQ version. 
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Example 4.3 (violation of the normal cone representations with no PMFCQ). 

Consider the infinite inequality system in given in Example 13. 6i It is shown therein 
that the EMFCQ holds at x = (-1,0) while the PMFCQ does not. It is easy to check that 
in this case N{x; 0) = N{x; 0) = iR+ x iR„ while 

cl cone{Vgt{x)\ t G Te{x)} = cl cone{(l,0) U {{t,0)\ t G (0,e)} ClR+ x {0}. 

i.e., the inclusions "C" in (j4.ip and (j4.2p are violated. 

The next example shows that the perturbed active index set Tf,{x) cannot be replaced 
by its unperturbed counterpart T{x) in the normal cone representations (j4.ip and ()4.2p . 



Example 4.4 (perturbation of the active index set is essential for the normal 
cone representations). Let us reconsider the nonlinear infinite system in problem (j3.7p : 

J gi{x) = xi + l<Q, 

1 9n{x) = ^xl-X2<^, nGW\{l}, 
in 

where x = {xi,X2) G IB^ and T := IN. It is easy to check this inequality system satisfies 
our standing assumptions and that the functions gt are uniformly strictly difi'erentiable at 
X = (—1,0). Observe further that = {(xi,X2) G 1R^\ xi < —1, X2 > 0} and hence 
N{x;0) = M+ X M-. As shown above, both PMFCQ and EMFCQ conditions hold at x. 
However, we have T{x) = {1} and 

N{x;0) / cone {Vgt{x)\ t G T{x)} = cone{V5i(x)} = cone {(1,0)} = 1R+ x {0}, 

which shows the violation of the unperturbed counterparts of (14. ip and (j4.2p . Observe that 

cone {V gt{x)\ t eTe{x)] = cone |(1, 0) U { (i, -l) | ?i G IV \ {1}, n > ^| 

= {{xi,X2) G ]R^\ xi > 0, X2 < 0}, 
which is not a closed subset. On the other hand, we have 

iV(x;0) = n cone {Vgt{x)\ t G T^ix)}, 

e>0 

which illustrates the validity of the normal cone representations in Theorem 14.21 

Now we derive several consequences of Theorem 14.21 which are of their independent 
interest. The first one concerns the case when the {V5t(x)| t G T} may not be bounded in 
X* as in our standing assumptions. It follows that the latter case can be reduced to the 
basic case of Theorem 14.21 with some modifications. 



Corollary 4.5 (normal cone representation for infinite systems with unbounded 
gradients). Considering the constraint system ()3.ip . assume the following: 

(a) The functions gt, t £T, are Frechet differentiahle at the point x with ||V5t(x)|| > 
for allt^T and the mapping h is strictly differentiahle at x. 

(b) We have that limr(77) = 0, where r[rf) is defined by 

rilO 

-/ N \9t{x) - gt{x') - {Vgt{x),x - x')\ 

riri) := sup sup t— — — 7. for all r? > 0. (4.12) 

iST x,x'&]Br,{x) \\^9t[.x)\\ ■ \\X - X'W 
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(c) The operator Vh{x) : X is surjective and for some e > there are x £ X and 
a > such that Vh{x)x = and that 

{'Vgt{x),x + x)<0 whenever ||x|| < fj (4-13) 

for each t G Ts{x) := {t G T\ gt{x) > —£\\Vgt{x)\\}. Then the limiting normal cone to at 
X is computed by formula (j4.2p . 

Proof. Define gt{x) '■= gt{x)\\V gt{x)\\^^ for all x £ X and t £ T and observe that the 
feasible set from (jl.2p admits the representation 

= {xeX\ gt{x) < 0, h{x) = O}. 

Replacing gt by gt in Theorem 14.21 we have that the functions {gt} and h satisfy the 
standing assumptions (SA) as well as condition (j3.3p with the function (j4.12p instead of 
r{r]). Furthermore, it follows from ()4.13p that for some e > there are x X and o" > 
satisfying Vh{x)x = and such that 

{'Vgtix),x) < - sup {'Vgtix),x) = -a\\Vgtix)\\ whenever teT^ix), 

which turns into (V'gt{x),x) < —a for all t G Ti,{x) = {t G Tj gt{x) > — e}. Hence the 
PMFCQ condition holds for the functions gt and h at x. It follows from Theorem 14.21 that 

N{x; 0) = Q cl*cone {Vgt{x)\ t G fe{x)} + V/i(x)*(y*) 

£>0 _ 

= fl cl*cone {Vgtix) \\Vgt{x)\\~^ t ^ T,{x)} + V/i(x)*(y*) 

£>0 _ 

= fl cl*cone {Vgt{x)\ t G T,(x)} + V/i(x)*(y*), 

£>0 

which gives (14. 2 p and completes the proof of the corollary. A 

Now we compare the result of Corollary 14.51 with the recent one obtained in [26\ Theo- 
rem 3.1 and Corollary 4.1] for inequality constraint systems, i.e., with h = in (13. ip . The 
latter result is given by the inclusion form 

iV(x;0)c f]cl*cone{Vgtix)\t eTsix)} 
e>0 

in the case of ||V(7f(x)|| = 1 for all t G T under the Frechet differentiability of gt around x 
(in (as) we need it merely at x) and the replacement of (b) of Corollary 14.51 bv the following 
equicontinuity requirement on gt at x: for each 7 > there is r/ > such that 

\\Vgt{x) - Vgt{x)\\ < 7 for ah x G ]B^{x), t G T. (4.14) 

Let us check that the latter assumption together with the Frechet differentiability of gt 
around x imply (b) in Corollary 14.51 Indeed, suppose that ()4.14p holds and then pick any 
x,x' G ]Bn{x). Employing the classical Mean Value Theorem, find x G [x,x'] C ]Bn{x) such 
that gtix) - gt{x') = {Wgt{x),x - x'). This gives 

\9t{x) - gtjx') - {Vgt{x),x - x')\ ^ I ( Vfff {x),x -x') - {Vgt (x) , x - x') | 
||V5t(x)|| • ||x — x'll ||x — x'll 

^ \{Vgt{x)-Vgt{x),x-x')\ 

~ \\x — x'll 

< \\Vgt{x)-Vgt{x)\\<^ 
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and yields lim r(r/) < 7 for all 7 > 0, which ensures the validity of (b) in Corollary 14.51 

The next consequence of Theorem 14.21 concerns problems of semi-infinite programming 
and presents sufficient conditions for the fulfillment of simplified representations of the 
normal cones to feasible constraints with no closure operations in (j4.ip and (|4.2p and with 
the replacement of the perturbed index set ^^(x) by that of active constraints T{x). 

Corollary 4.6 (normal cones for semi-infinite constraints). Let X and Y he finite- 
dimensional spaces with diniY < dvaiX. Assume that T is a compact metric space, that the 
function t £ T gt{x) is u.s.c, and the mapping t £ T Vgt{x) is continuous. Suppose 
further that system (j3.ip satisfies the PMFCQ at x. Then we have 

N{x;@) = cone{Vgt{x)\ t G T(x)} + V/i(x)*(y*), (4.15) 

where N{x; 0) = N{x; 0) when the functions gt are uniformly Frechet differentiable at x 
and N{x;0) = N{x;0) when gt are uniformly strictly differentiable at x. 

In particular, if we assume in addition that both t £ T gt{x) and {x,t) £ X xT \/gt{x) 
are continuous, then we also have (I4.15P for N{x;0) = N{x;0) provided that merely the 
EMFCQ condition holds at x. 

Proof. Let X = M'^ for some d G IN. It follows from Proposition 13.11 that gt, t £T, and h 
satisfy our standing assumptions (SA). Since system (13. ip satisfies the PMFCQ at x, there 
are e > 0, 6 > 0, and x £ X such that {S/gt{x),x) < —6 for all t € Ti;{x) and e € (0,e). 
Observe that the perturbed active index set T^{x) is compact in T for all e > due to the 
u.s.c. assumption on i G T 1— )■ gt{x). It follows from the continuity of t € T 1— >■ Vgt{x) that 
{Vgt{x) \ t G Ts{x)} is a compact subset of IR!^. 

We now claim that ^ co{V(7((S)| t G Tg{x)}. Indeed, it follows for any A G M^^^^ 
with EtGT,{x) ^* = 1 ^^^^ 

M'^9tix),x) <- Xt5 = -5<0, 

which yields that / Y^teT^(x) ^t^9t{x), i.e., ^ co{V gt{x)\ t G Te{x)}. 

Hence it follows from |16|. Proposition 1.4.7] that the conic hull cone{V(7j(x)| t G T^{x)} 
is closed in IR'^. Combining this with Theorem 14. 2( it suffices to show that 

Pi cone{Vc/t(x)| t£Te{x)] = cone {V5ff(x)| t G T{x)]. (4.16) 

e>0 

Observe that the inclusion "D" in (14.16P is obvious due to T{x) C Ts{x) as e > 0. To justify 
the converse inclusion, pick an arbitrary element x* from the set on the left-hand side of 
(j4.16p . By the classical Caratheodory theorem, for all large n £ IN we find A„ G M'^^ and 

Vgt„^{x),...,Vgt„^^^{x) £ {V gt{x)\ t £ T^{x)} C M'' 

satisfying the relationship 

d+l 

^* = E^"'=^5i„,(x), (4.17) 
k=l 
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which imphes in turn that 

d+1 d+1 

{x*,x) = ^Xn^{\7gt„^{x),x) < -"^Xni^d. 

k=l k=l 

Hence the sequence {A^} is bounded in IR^^^ , and so is 

{A„ X (V9i„^ (x), . . . , Vgt^^^^)] C JR^+i X iR^('^+i). 

By the classical Bolzano- Weierstrass theorem and the compactness of T, we assume without 
loss of generality that the sequence } converges to some € T for each 1 < A: < d + 1 
and that {A„} converges to some A G IR'^^^ as n — )■ oo. Note that > gt^^ {x) > — ^ for all 
n £ IN sufficiently large, which gives us 

> Qt^ {x) > lim sup gt^ (x) > lim sup =0 

n—^oo ~ n—>oo IT' 

for all 1 < k < d + 1. Combining the latter with (|4.17p ensures that 

d+1 

X* = ^AfcV5rf^(x) € cone{Vc/t(x)| t G T{x)}, 
k=i 

which yields the inclusion "c" in ()4.16p . Thus we arrive at formula (j4.15p . 

The second part of the corollary follows from the first part, Proposition 13.11 and Propo- 
sition [33J This completes the proof of the claimed result. A 

The results obtained in Corollary 14. 61 can be compared with [3 Theorem 3.4], where "C" 
in (I4.15P was obtained for h = under the following conditions: T is scattered compact 
(meaning that every subset S C T has an isolated point), gt are Prechet differentiable for 
all t £ T, the mappings {x,t) £ X xT i-^ gt{x) and (x, t) G X x T i— )• Vgt{x) are continuous, 
and the EMPCQ condition holds at x. We can see that these assumptions are significantly 
stronger than those Corollary 14.61 Note, in particular, that the scattering compactness 
requirement on the index set T is not different in applications from T being finite. 

The next question we address in this section is about the possibility to obtain normal 
cone representations of the "unperturbed" type as in Corollary 14.61 while in infinite pro- 
gramming settings with no finite dimensionality, compactness, and continuity assumptions 
made above. The following theorem shows that this can be done when the PMFCQ is 
accompanied by the NPMCQ condition of Definition 13.81 

Theorem 4.7 (unperturbed representations of normal cones for infinite con- 
straint systems). Let the functions gt, t £ T, be uniformly Frechet differentiable at 
X, and let that system ()3.ip satisfy the PMFCQ and NFMCQ conditions at x. Then 

N{x; 0) = cone {Vgt{x)\ t G T{x)} + Vh{x)*{Y*). (4.18) 

If in addition the functions gt, t £T, are uniformly strictly differentiable at x, then 

N{x;0) = cone {Vgt{x)\ t G T{x)} +Vh{xy{Y*). (4.19) 
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Proof. First we claim that the set crcone {V(74(x)| t € Ti;{x)} belongs to the set 



e>0 



{x* €X*\ {x\{x*,x))€cl* cone {{S/gt{x),{S/gt{x),x)-gt{x))\t£T}y (4.20) 

Indeed, it follows from the PMFCQ for (j3.ip at x that Vh{x) is surjective and there are 
e > 0, (5 > 0, and x € X such that Vh{x)x = and that {'Vgt{x),x) < —6 for all 
e < e and t S Ti:{x). To justify the claimed inclusion to (|4.2U|) . pick an arbitrary element 
X* G cFcone {Vgt(x)| t € T'e(x)} and for any e G (0,e) find a net {Xu)u&j\f C iR+ with 

e>0 



x*=w*-lim y At^Vgt(x). (4.21) 



This implies the relationships 



(x ,rE) = lim > A(^(Vgt(x), x) < — Jlimsup > Afj^ and (4.22) 



(x*,x) = lim y Xty{Vgt{x), x) =lim } \ty{{V gt{x) , x) - gt{x) + gt{x)) . 
The later equality together with (j4.22p give us that 

> (x*,x) -limsup Xtui{ygtix),x) - gt{x)) > liminf XtuQtix) > |(x*,x). 

teTe(x) teT^ix) 

By passing to a subnet and combining this with (j4.2ip . we get 

(x*, (x*,x)) G crcone{(V9t(x), {Vgtix),x) - gt{x))\ t (£ T} + {0} x [^{x*,x),0] 

for all e G (0, e), which implies that x* belongs to the set in ()4.20p by taking e J, 0. 
Involving further the NFMCQ condition, we claim the equality 

Pi cl*cone {Vgt{x)\ teT,{x)} = cone {Vgt{x)\ t G T(x)}. (4.23) 

e>0 

The inclusion "D" in (j4.23p is obvious since r(x) C 7e(x) for all e > 0. To justify the 
converse inclusion, pick any x* belonging to the left-hand side of ()4.23p . By the NFMCQ 
condition, it follows from (I4.20p that there is A G such that 

(x*,(x*,x)) = ^At(V<7t(x),(V5t(x),x)-5i(x)), (4.24) 
teT 

which readily yields the equalities 

= Y, Xt{Vgt{x),x) - \t{{^gt{x),x) - gt{x)) = Xtgt{x). 
teT teT teT 

Since gt{x) < 0, we get \tgt{x) = for all t & T. Combining this with (I4.24p gives us 

X* G cone gt{x)\ t G T(x)}, 
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which imphes the inclusion "C" in (j4.23|) . To complete the proof of the theorem, we combine 
the obtained equality (j4.23p with finally Theorem 14.21 A 



Observe from Proposition 13.111 that formula (14.180 holds under our standing assump- 
tions (SA) and the MFCQ condition at x when T is a finite index set. Furthermore, the 
formula for the limiting normal cones ()4.19p is also satisfied if all the functions gt are strictly 
differentiable at x. It follows from Proposition 13. 1 11 that Corollary 14.61 can be derived from 
a semi-infinite version of Theorem 14.71 in addition to the assumptions of this corollary we 
suppose that the function t E T i— > gtix) is continuous in T. 

The next example shows that the PMFCQ condition cannot be replaced by the EMFCQ 
one in Theorem l4.7l to ensure the unperturbed normal cone representations ()4.18p and (j4.19p 
in the presence of the NFMCQ. 

Example 4.8 (EMFCQ combined with NFMCQ does not ensure the unper- 
turbed normal cone representations). We revisit the semi-infinite inequality constraint 
system in Example 13.31 It is shown there that this system satisfied the EMFCQ but not 
PMFCQ at X = (—1,0). It is easy to check that the set 

cone {{Vgt{x), {Vgt{x),x) - gt{x)) \ t e T} = cone ((1, 0, -1) U {(t, 0, 0)|t € (0, 1]}) 

= {x e ]R^\ Xi + X3>0, Xi>0> X3, X2 = 0} 

is closed in iR^, i.e., the NFMCQ condition holds at x. Observe however that both repre- 
sentations (|4.18p and (I4.19P are not satisfied for this system since we have 

N{x;0) = N{x;0) + cone{V5i(x)| t e T[x)\ = cone {(1,0)} = 1R+ x {0}. 

Now we present a consequence of Theorem 14.71 with the corresponding discussions. 

Corollary 4.9 (normal cone for infinite convex systems). Assume that all the func- 
tions gt, t T, in (13. ip are convex and uniformly Frechet differentiable and that h = A 
is a surjective continuous linear operator. Suppose further that system (|3.ip satisfies the 
PMFCQ [equivalently the SSC) at x G 0. Then the normal cone to at x in sense of 
convex analysis is computed by 

N{x; 0) = fl cl*cone {Vgt{x)\ t G r,(x)} + A*{Y*). 

e>0 

If in addition the NFMCQ holds at x, then we have 

N{x;&) = cone{\/gt{x)\ t G T{x)} + A* {¥*). (4.25) 

Proof. It follows directly from Proposition 13.71 and Theorem 14.71 A 

For /i = in (|3.ip the equality in (|4.25p can be deduced from [TTl Corollary 3.6] under 
another Farkas- Minkowski Constraint Qualification (FMCQ) defined as follows: 

(FMCQ) The conic hull cone{epig^| t G T} is weak* closed in X* x M under the 
additional assumption that the functions gt are l.s.c, where 

Lp*{x*) := sup{(2;*,2;) - ^p{x)\ x G X] , x* G X* , 
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stands for the Fenchel conjugate of a convex function. 

It is worth noting that the above FMCQ condition is a global property, and hence 
formula ()4.25p holds at every a; € 0. By the contrary, our new NFMCQ condition (13. lip is 
constructed at a fixed point a; G 0. The next example shows that the combination of the 
PMFCQ (or the SSC) and the NFMCQ conditions for infinite convex inequality systems is 
not stronger than the FMCQ one. 

Example 4.10 (PMFCQ combined with NFMCQ does not imply FMCQ for 
convex inequality systems). Define a function gt : M hy gt{xi,X2) := tx\ — X2 

for all {xi,X2) € and t e T := (0, 1), and let x = (0,0) € M^. It is easy to see that 
all the functions gt,t^T, are convex and differentiable and that the standing assumptions 
are satisfied. For each t ^ T we have 

f ^ if = -1 

g*{ai,a2)= sup {aiXi + 02X2 - txl + X2} = < 4t ^ '^^ ' 
(xi,x2)eM'^ I 00 otherwise. 

2 

This implies that epi g^ = {{a, —1, ^ + r) \ a € IR, r > 0}, which yields in turn that 

C := cone {epi 5^] t € T} = cone |(a, —1, + ^) a £ M, r > o|. 

The latter set is not closed in iR^ since {0} x {0} x M+ <^ C while {0} x {0} x C clC. 
Moreover, we see that Vgt{x) = (0, —1) for all t £ T, and then the PMFCQ is satisfied. 
Furthermore, it follows that the set 

cone{{Vgt{x),{Vgt{x),x) -gt{x))\ t € T} = cone {(0, -1, 0)} = {0} x iR„ x {0} 

is closed in IR^ . Hence the PMFCQ and NFMCQ conditions hold but the FMCQ does not. 

Finally in this section, we give specifications of obtained normal cone representations in 
the case linear infinite systems. 

Proposition 4.11 (normal cone representations for linear infinite constraint sys- 
tems). Consider the constraint system (13. ip with gt{x) = {a^,x) — bt for all t £ T, and 
let h = A : X ^ Y . Assume that A is a surjective continuous linear operator and that the 
coefficient set {a^ \ t G T} is bounded in X* . If the SSC condition holds at x, then 



iV(x;0) = crconeja^*! t £ T,{x)} + A* {¥*) 



e>0 



for the feasible set := {x € X\ Ax = 0, {a^,x) — 6t < 0, t £ T}. On the other hand, 
assuming the weak* closedness 0/ cone {(a*, 6j)| t S T} in X* x M and that h = gives us 

N{x-0) = cone { Oil t € T{x)]. 

Proof. The first statement is a specification of Corollary 14.91 The second one follows from 
the proofs given in [51 Proposition 3.1] and [6l Theorem 3.2] by using the classical Farkas 
Lemma for linear infinite systems. A 
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5 Optimality Conditions in Nonlinear Infinite Programming 



In this section we employ general principles in optimization and the calculus results on com- 
puting the normal cones to the infinite constraint sets in Section 4 to deriving necessary 
optimality conditions for problems of infinite and semi-infinite programming. We confine 
ourselves to optimality conditions of the "lower" subdifferential type conventional in min- 
imization. Condition of the other ("upper" or superdifferential) type can be derived from 
the calculus results of Section 4 using an approach developed in [22l Chapter 5]; see also the 
recent paper [6] for the implementation of the latter approach in the case of semi-infinite 
and infinite programs with linear constraints. 

Our first theorem in this section concerns infinite programs of type (jl.ip in arbitrary 
Banach spaces involving Frechet differentiable cost functions. 

Theorem 5.1 (necessary optimality conditions for differentiable infinite pro- 
grams in general Banach spaces). Let x be a local minimizer of the infinite program 
(jl.ip under the PMFCQ condition imposed on the constraints at x. Suppose further that 
the inequality constraint functions gt, t £ T, are uniformly Frechet differentiable at x and 
the cost function f is Frechet differentiable at this point. Then we have the inclusion 

G V/(x) + Pi cl* cone {ygt{x) \ t G T^ix)} + \/h{x)*{Y*). (5.1) 

If in addition the NFMCQ holds at x, then there exist multipliers A G IR^ and y* G Y* 
satisfying the differential KKT condition 

= V/(x)+ hygt{x) + Vh{xyy\ (5.2) 

Proof. It is clear that x is a local optimal solution to the following unconstrained opti- 
mization problem with the infinite penalty: 

minimize /(x) + (5(x; 0), (5.3) 

where is the feasible constraint set (jl.2p . Applying the generalized Fermat rule to the 
latter problem (see, e.g., [22l Proposition 1.114]), we have 

Og5(/ + <5(-;0))(x). (5.4) 

Since / is Frechet differentiable at x, it follows from the sum rule of [221 Theorem 1.107 ] 
applied to (|5.4p and from the first relationship in (j2.4p that 

G V/(x) + d5{x] 0)(x) = V/(x) + iV(x; 0). (5.5) 

Now using the Frechet normal cone representation of Theorem 14.21 in (|5.5p . we arrive at 
(jS.ip . The second part (j5.2p of this theorem readily follows from Theorem 14.71 A 

The next theorem establishes necessary conditions for local minimizers of infinite pro- 
grams (jl.ip with general nonsmooth cost functions in the framework of Asplund spaces. 
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Theorem 5.2 (necessary optimality conditions for nonconvex infinite programs 
defined on Asplund spaces, I). Let x be a local minimizer of problem (jl.ip . where the 
domain space X is Asplund while the image space Y is arbitrary Banach. Suppose that 
the constraint functions gt, t € T, are uniformly strictly differentiable at x, that the cost 
function f is l.s.c. around x and SNEC at this point, and that the qualification condition 

f {x)r\\^-[^cr cone {V gt{x)\ t e Te{x)] -Vh{x)*{Y*) ={0} (5.6) 

e>0 

is fulfilled; the latter two assumptions are automatic when f is locally Lipschitzian around 
X. If the PMFCQ condition holds at x, then 

G df{x) + Pi cT cone {Vgt{x) \ t G Te{x)] +Vh{xy{Y*). (5.7) 

e>0 

// in addition we assume that the NFMCQ holds at x and replace (j5.6|) by 



a°°/(x)n - cone {V gt{x)\ t eT{x)] -Vh{xY{Y*) ={0}, (5.8) 

then there exist multipliers A G IR^ and y* G Y* such that the following subdifferential KKT 
condition is satisfied: 

Og5/(x)+ XtVgt{x) + Vh{xry*. (5.9) 
teT(x) 

Proof. Observe first that the feasible set is locally closed around x. Indeed, it follows 
from (13. 3p that there are 7 > and i] > sufficiently small such that 

\\h{x) - h{x')\\ < (||V/i(S)||+7)||x-x'|| and \\gt{x) - gt{x')\\ < suv{\\Vgr{x)\\ + - ^'l 

for all x,x' G IBjj{x) and t ^ T. Picking any sequence {xn} C H lBr^{x) converging to 
some as n — 7> 00, we have 

||/i(a:;o)|| < (l|V/i(x)|| + 7)|Ix.„ - xo|| and gt{xQ) < sup(||Vs'^(x)|| + 7)||x„ - xo|| + gt{xn) 

for each t ^ T and n ^ JN . By passing to the limit as n ^ 00, the latter yields that 
h{xQ) = and gt{xo) < for all t G T, i.e., xq G fl lBri{x), which justifies the local 
closedness of the feasible set around x. 

Employing now the generalized Fermat rule to the solution x of (15. 3p with the closed set 
and using [22\ Theorem 3.36] on the sum rule for basic/limiting subgradients in Asplund 
spaces when / is SNEC at x yield that 

G a(/ + 6{-, 0)) (x) C df{x) + d5{x; 0) = df{x) + N{x; 0) (5.10) 

provided that d°° f{x) H ( — N{x] 0)) = {0}. We apply further to both latter conditions the 
limiting normal cone representation of Theorem 14.21 This gives us the optimality condition 
(|5.7p under the fulfillment of (15. 6p and the PMFCQ at x. Applying finally Theorem 14.71 
instead of Theorem 14.21 in the setting above, we arrive at the KKT condition (15. 9p under 
the assumed NFMCQ at x and ()5.8p . which completes the proof of the theorem. A 

An important ingredient in the proof of Theorem 15.21 is applying the subdifferential sum 
rule from |22l Theorem 3.36 ] to the sum / + 6{-] 0), which requires that either / is SNEC 
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at X or is SNC at this point. While the first possibihty was used above, now we are 
going to explore the second alternative. The next proposition presents verifiable conditions 
ensuring the SNC property of the feasible set at x. 

Proposition 5.3 (SNC property of feasible sets in infinite programming). Let X 

he an Asplund space, and let dimy < oo m the framework of Assume that all the 

functions gt, t € T, are Frechet differentiable around some x £ and that the corresponding 
derivative family {'^gt}teT is equicontinuous around this point, i.e., there exists e > such 
that for each x € JBf,{x) and each 7 > there is <e < e with the property 

\\Vgt{x') — Vgt{x)\\ < 7 whenever x' € lB^{x) n and t £T. (5-11) 

Then the feasible set in (jl.2p is locally closed around x and SNC at this point provided 
that the PMFCQ condition holds at x. 

Proof. Consider first the set 0i := {x G X\ gt{x) < 0, t G T}. By using arguments similar 
to the proof of Theorem 15. 2| we justify the local closedness of 0i around x. Now let us 
prove that 0i is SNC at this point. To proceed, pick any sequence G 0i x X*, 

n G IV, satisfying 

Xn ^ 2;, x* G N{xn; 0i) and rc* ^ as n ^ 00. 

Taking (jS.lip into account, we see that the functions gt, t £ T satisfy the standing as- 
sumptions (SA) at Xn for all n G W sufficiently large. Moreover, the proof showing 
that assumption ()3.3p holds at Xn follows from the discussions right after Corollary 14.51 
Since the PMFCQ condition holds at x, there exist 5 > 0, e > 0, and x G X such that 
{'Vgt{x),x) < —26 for all t G T2e{x). Observe that T^{xn) C T2e{x) for all large n G IN. 
Indeed, whenever t G T^{xk) we have 

0>gt{x) > gt{xn) - {S/gt{x),Xn - x) - \\xn - x\\s{\\xk - x\\) 

> -e - sup \\Vgrix)\\ ■ - x|| - p„ - x||s(||x„ - x\\) > -2e 

reT 

for all large n JN, where s(-) is defined in (13. 2p . Further, it follows from (|5.11|) that 
{Vgt{xn),x) < {Vgt{x),x) + \\Vgt{xn) - Vgt{x)\\ ■ \\x\\ < -25 + \\Vgt{xn) - V5t(x)|| • P|l < -6 
when n (z IN is sufficiently large. Hence we suppose without loss of generality that 

Ts{xn) C T2e{x) and sup {'Vgt{xn),x)<—5 whenever n G IN. (5.12) 

Applying now Theorem 14.21 in this setting, we have that for each n £ M there exists a net 
{KJueM C ^2+^"^"^ such that 

xl = w* - lim Ai„^V5'j(xn). 

Combining this with (j5.12p yields that 

(x;,x) = lim Xtn,{Vgt{xn),x) < -6 lim'mf At„^. 
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Furthermore, for each j; G X we get the relationships 



{x*^,x) = hminf At„^(Vfi(t(x„), j;) < hminf At„„ sup || Vfif^ (x„) || • ||x|| 

< -^^^sup||V(7r(x„)|| • ||x||, 

which imply that |lx*|| < — ^^'^'^^ sup^gy || V^rl^^n) || for all n € M. Since x* 0, it follows 
from the latter that H^* || — t- as n — ?• cxo and thus the set 0i is SNC at x. 

Consider now the set 02 := {x G X| = 0}, which is obviously closed around x. 
It follows from \22\ Theorem 1.22] and finite dimensionality of Y that 02 is SNC at x. 
Moreover, we get from |22l Theorem 1.17] that A^(x;02) = Vh{x)*{Y*). Thus for any 
x* G N{x; 0i) n {-N{x; 02)) there is y* G Y* such that x* + Vh{x)*y* = 0, and then 

= -{Vh{x)*y\x) = -{y*,Vh{x)x) = 0. 

Since x* G N{x;0i), we find by Theorem 14.21 such a net {A,y}i,g_/v^ G IR^ that 

x* = - lim \tyVgt{x), 

which yields in turn that 

= (x* ,x) = lim > Xtiy{Vgt(x),x) < — 2(51iminf N Ati/. 

This ensures the relationships 

(x*, x) = liminf N Ati/(V5'f(x), x) < liminf > Ati/ sup || (V(7t-(2;) || = 
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for ah X e X. Hence we have x* = 0, and so N{x;0i) n (-iV(x;02)) = {0}. It finally 
follows from |22|, Corollary 3.81] that the intersection = 0i n 02 is SNC at x, which thus 
completes the proof of the proposition. A 

Observe that the assumption dim K < oo is essential in Proposition 15.31 To illustrate 
this, consider a particular case of (jl.ip when T = 0. It follows from \22\ Theorem 1.22] 
that the inverse image = h~^{0) is SNC at x G if and only if the set {0} is SNC at 
G y. Since A^(0; {0}) = Y*, the latter holds if and only if the weak* topology in Y* 
agrees with the norm topology in Y*, which is only the case of dimy < oo by the classical 
Josefson-Nissenzweig theorem from theory of Banach spaces. 

Now we are ready to derive an aforementioned alternative counterpart of Theorem 15.21 

Theorem 5.4 (necessary optimality conditions for nonconvex infinite programs 
defined on Asplund spaces, II). Let x be a local minimizer of infinite program ()3.ip 
under the assumptions of Proposition [5l3l Suppose also that f is l.s.c. around x and that 
the qualification condition (j5.6p is satisfied. Then we have the optimality condition (j5.7p . 
If in addition we assume that the NFMCQ holds at x and replace (15. 6p by (jS.Sp , then there 
exist multipliers A G iRT and y* G Y* such that the subdifjerential KKT condition (j5.9p . 
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Proof. It is similar to the proof of Theorem 15.21 with applying Proposition 15.31 on the SNC 
and closedness property of in the sum rule (|5.10p of |22^ Theorem 3.36]. A 

The next result provides necessary and sufficient optimality conditions for convex prob- 
lems of infinite programming in general Banach spaces. 

Theorem 5.5 (necessary and optimality conditions for convex infinite programs). 

Let both spaces X and Y he Banach. Assume that all the functions gt, t & T, are convex and 
uniformly Frechet differentiable and that h = A is a surjective continuous linear operator. 
Suppose further that the cost function f is convex and continuous at some point in 0. If the 
PMFCQ condition {equivalently the SSC condition) holds at x, then x is a global minimizer 
of problem (jl.ip if and only if 

G df{x) + Pi cl* cone {ygt{x) \ t G T^{x)^ + A*{Y*). 

If in addition the NFMCQ condition holds, then x is a global minimizer of problem (jl.ip if 
and only if there exist A G IR^ and y* G Y* such that 

Oedf{x)+ ^ XtVgt{x) + A*y*. (5.13) 

teT(x) 

Proof. Observe that x is a global minimizer of problem (jl.lh if and only if it is a global 
minimizer of the convex unconstrained problem (j5.3p . which is equivalent to the fact that 

Og5(/ + 5(-;0))(x). 

Applying the convex subdifferential sum rule to the latter inclusion, we conclude that x is 
a global minimizer of problem (jl.ip if and only if 

G df{x) + d6{x; 0) = df{x) + N{x; 0). 

The rest of the proof follows from Corollary 14. 91 A 

Note that some versions of necessary optimality condition of the KKT type (j5.13p were 
derived in [BJ Theorems 3.1 and 3.2] for infinite problems with linear constraints but possibly 
nonconvex cost functions under the SSC and the linear counterpart of the FMCQ; see 
Example 14.101 and the corresponding discussions above. 

Observe also that the results of Theorem 15.41 and Theorem 15.51 are formulated with no 
change in the case of semi-infinite programs, while in Theorem 15.11 we just drop the SNEC 
assumption on /, which holds automatically when X is finite-dimensional. 

In conclusion we present a consequence of our results for the classical framework of 
semi- infinite programming while involving nonsmooth cost functions. 

Corollary 5.6 (necessary optimality conditions for semi-infinite programs with 
compact index sets). Let x be a local minimizer of program (jl.ip . where both spaces X 
and Y are finite- dimensional with dimY < dimX. Assume that the index set T in (jl.ip is a 
compact metric space, that the mappings {x,t) : X xT ^ 9t{x) and {x,t) : X xT Vgt{x) 
are continuous, and that the cost function f is l.s.c. around x with the fulfillment of (jS.Sp . 
If in addition the EMFCQ holds at x, then there exist multipliers A G IR^ and y* G Y* 
satisfying the subdifferential KKT condition (j5.9p . 
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Proof. By Proposition 13.91 we have that the NFMCQ condition holds at x under the 
assumptions made. Then this corollary follows directly from Theorem 15.21 A 



When / is smooth around x, assumption ()5.8p holds automatically while (15. 9p reduced to 
the differential KKT condition ()5.2p . Then Corollary 15.61 reduces to a well-known result in 
semi-infinite programming that can be found, e.g., in [151 Theorem 3.3] and [211 Theorem 2]. 
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